CLAIMS 

What is claimed is: 

1 . An apparatus comprising: 

a sensor unit to capture wavelength intensity data for a plurality of pixel locations 
wherein the sensor generates a value corresponding to an intensity of light from a 
selected range of wavelengths for the pixel locations and further wherein infrared 
intensity values are generated for a subset of the pixel locations; and 

an interpolation unit coupled with the sensor unit to interpolate intensity data to 
estimate intensity values not generated by the sensor. 

2. The apparatus of claim 1 wherein the red, green, blue and infrared 
intensity information are captured substantially contemporaneously. 

3. The apparatus of claim 1 further comprising: 

a red pixel buffer coupled with the interpolation unit to store red intensity data; 
a green pixel buffer coupled with the interpolation unit to store green intensity 

data; 

a blue pixel buffer coupled with the interpolation unit to store blue intensity data; 

and 

an infrared pixel buffer coupled with the interpolation unit to store infrared 
intensity data. 
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4. The apparatus of claim 3 further comprising a signal processing unit 
coupled to the red pixel data buffer, the green pixel data buffer, the blue pixel data buffer 
and the infrared pixel data buffer. 

5. The apparatus of claim 1 wherein the sensor unit captures intensity data 
according to a predetermined pattern comprising: 



B 


R 


B 


R 


IR 


G 


IR 


G 


B 


R 


B 


R 


IR 


G 


IR 


G 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



6. The apparatus of claim 5, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

_ X(m-l,n) + X(m + l,n) ^ ^ red intensity corresponding to the location (m,n) is 



given by 



= X(m,n-l)+X{m,n + \) ^ ±q green intensity corresponding to the location 



X(m-\.n- l) + X(m-\,n + \) + X(m+hn-\) + X(m + \,n + \) 
(m,n) is given by G = 4" 



and the blue intensity corre: 



sponding to the location (m,n) is given by B = x(m, n). 
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7. The apparatus of claim 5, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 
X (m - U-l) + X(m + U-\) + X(m-ln + \)+X{m + \,n + \) ^ ^ red intensity 



IR = 



corre: 



spending to the location (m,n) is given by R = X(m, n) , the green intensity 



. , v , - X(m-U) + X(m + l,n) dfce 

corresponding to the location (m,n) is given by G - 2 

blue intensity corresponding to the location (m,n) is given by 

X(m,n-\)+X(m,n + \) 
B — " 



8. The apparatus of claim 5, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = {m, n) , the red intensity corresponding to the location (m,n) is given by 

Ylm -\.n-\)+X(m + hr,-\)+X(m-\,n + \)+X {m + l,n + i) ^ ^ ffeea intensity 
R = 4 

t • X(m,n-\)+X(m,n + \) nAtllp 

corresponding to the location (m,n) is given by G - ~ 

blue intensity corresponding to the location (m,n) is given by 
X(m-\,n)+X(m+\,n) 



42P17531X 



-25- 



Express Mail No. EV 325528247 US 



9. The apparatus of claim 5, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 

integers, the infrared intensity corresponding to the location (m,n) is given by 

X(m,n-\)+X(m,n + l) the red intensit y corresponding to the location (m,n) is 
IR- 2 

. X (m-\,n) + X(m + l,n) & intensity corresponding to the location 
given by R = ^ " ' & 

(m,n) is given by G = X(m, n) , and the blue intensity corresponding to the location (m,n) 

X(m -Ln-l) + X(m + \,n-l) + X(m-l,n + i)+X(m + \,n + \) 
is given by B = ~~ 4~ 



10. The apparatus of claim 1 wherein the sensor unit captures intensity data 
according to a predetermined pattern comprising: 



IR 


R 


IR 


B 


G 


IR 


, G 


IR 


IR 


B 


IR 


R 


G 


IR 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



11. The apparatus of claim 10, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m,n) , and the green intensity corresponding to the location (m,n) is given by 

Express Mail No. EV 325528247 US 



42P17531X 



-26- 



G = X{m-\,n) + X(m + \,n) ^ ^ wherein if the p i xe l at location (m,n-l) is red, 

the blue intensity corresponding to the location (m,n) is given by B = X{m > n + 1) and the 
red intensity corresponding to the location (m,n) is given by R = X(m, n - 1) , and if the 
pixel at location (m,n-l) is blue, the red intensity corresponding to the location (m,n) is 
given by R = X(m, n + 1) and the blue intensity corresponding to the location (m,n) is 
given by B = X(m,n-l). 

12. The apparatus of claim 10, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

TD _ X(m - 1, n) + X(m + 1, n) + X{m, n - 1) + X(m, n + 1) ^ ^ m intensity 
IR- J- 

corresponding to the location (m,n) is given by 

X{m -In -l) + X(m + l,n-\)+X(m-\,n + \)+X(m + l,n + l) ^ wherein 
G= 4 

if the pixel at location (m,n) is red, the blue intensity corresponding to the location (m,n) 

. D X(m - 2. n)+ X(m + 2, n) + X(m, n - 2) + X{m, n + 2) ^ ^ ^ 
is given by B = ■ ^ 

intensity corresponding to the location (m,n) is given by R = X(m, n) , and if the pixel at 

location (m,n) is blue, the red intensity corresponding to the location (m,n) is given by 

B = X(m, n) and the blue intensity corresponding to the location (m,n) is given by 

X(m -2,n)+X{m + 2,n)+X{m,n-2) + X(m,n + 2) 
R = — — 
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• r in the predetermined pixel 

13 Theapp^ofdaimlO.wtaremforap.xe.mtep 

States a column and X(m,n) 
pattem in a iooation whe K n, incica.es a row and n , nd.oa.es a 

, loth epixelinu,eloca t io n (m,n),ifm i s m evenm,eger 
is the intensity conespondmg to the ptxelm (mI a isB iven 

— — — etoCattM(nWl)lS8 
^^n+T^^ and green intensity 

by IR = : 

. r v (m „) and further wherein if the 
correspond.ngtotheloeationM.sgtvenbyG-^^n) 

pixel at location (m-l,n-l) is reo, 

^VLtlhl^^ and the red intensity corresponding to the 
given by B - Y~ 

_ X^nj^ , and if the pixel at location 

location (m,n) is given by R = 2 

X(» lz l :! ili)i(2±l^ and the bine intensity corresponding to the .ocatton 
R= Y~ 

(m,n) is given by B - - 2 

,iin wherein for a pixel in the predetermined pixel 
14 . The apparatus of claim 10, wherein 

^ „ inriirates a column and X(m,n) 
^.a^on^wneront^a^andnntdta. 

.thctntensityco^ondingtothepixeiindteiocauon^.nrannna 

X(^Jt2i£SH±a and fhrlher wherein if the pixel at location (m-r,») - red, 
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(m,n)isgivenbyB=4'» + l.") and,he 



the blue intensity corresponding to the loeatton l 
^^co r responain g .o tt te,o«aon(n 1 ,) i8gi venb y i i =X( m -», n ),andtfthe 

^^^^^-^--^^^^ 
giv en * * - * ♦ U.) -d the b.ne intensity corresponding to the .ocation (m,n) ts 

given by B = X{m-l,n). 



! 5 . The apparatus of claim 1 wherein the sensor unit captures intensity data 
according to a predetermined pattern comprising: 



B 



B 



R 
IR 



B 



B 



IR 



R 



IR 



R 



IR 



j 



where R indicates red intensity information 



, G indicates green intensity information, B 



indicates blue intensity information 



and IR indicates infrared intensity information. 



16 Tta apparatus of claim .5, wherein for aplxel in the predetermined pixel 
pattern lu a location (m,n) where m indicates a row and n Indicates a column and X(m„ 
ist he,n,e»s i .ycorrespondi»g.o«hepixe, i nme,oca, i on(m,n,,,fma„dna r ebo,hodd 

integers, the infrared intensity responding to the location (m,n) is given by 



IR = 



(m _ 1 „_ 1 ) +z ^_i i! h : i)^^ 

_ Ximji-^+J^^ the green 
corresponding to the location (m,n) is given by R = 2 
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X(m-l,n) + X(m + l,n) 

intensity corresponding to the location (m,n) is given by G - - — 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 



17. The apparatus of claim 15, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

X(m-\,n) + X(m + \,n) ±q red intensity corresponding to the location (m,n) is 
2 



given 



by R = X{m, n) , the green intensity corresponding to the location (m,n) is given by 

X{m - \ ,n-\) + X{m + \,n-\) + X{m-\,n + \)+X{m + \,n + \) ^ ^ ^ 
G= ■ ^~ 

X(m,n-\)+X(m,n + \) 
intensity corresponding to the location (m,n) is given by B - - 



18. The apparatus of claim 15, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = X(m,n-l) + X(m,n + l) ^ ±q ^ intensity corresponding to the location (m,n) is 



is 



X(m - 1, n -\) + X(m + l,n-l)+X(m + hn + \)+ X{m+\,n-l) ±Q 
given by R = ■ ^ 
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intensity „n di n g ,o tt ,e.oca«o.(o.,n,i Sgi venb yG ^<»,«).-^eMue 
intensity corresponding to the location (m,n) is given by B = — 2 



19 The apparatus of claim 1 5, wherein for a pixel in the predetermined pixel 

IR = n) . the red intensity corresponding to the location (m,n) is gl ven by 

X(mzl^)±l^±^ the green intensity corresponding to the location (m,n) is 
R- 2 

Xton + V + Xfa n-Vl ^ ^ the blue intensity corresponding to the 
given by G = ■ ^ 

location (m,n) is given by 

[ _ 1 ,„-1) + X(m ± l 1 «ll^^ 



5 = 



X(m- 



20. The apparatus of claim 1 wherein the sensor unit captures intensity data 
according to a predetermined pattern comprising: 



B 


G 


B 
IR 


B 

| R 




IR j 

B 

IR 


R 
G 
R 


B 
IR 


G 

R 





, G indicates green intensity information, B 



where R indicates red intensity information. 
mdic a,es h,ue intensity information and IR indicates infrared intensity information. 



Express Mail No. EV32552824IUS 

42P17531X 



2 , n. apparatus of data 20, wherein for a pixe, in the preoe.en.ined pixe. 

and n indicates a column and X(m,n) 



pattern in a location (m,n) where m indicates a row 



is the intensity corre 



espondingtothepixelinthelocatton^ifmandnarebothodd 
^theinfraredintensity corresponding to the location ( m ,n) is given by 

_ X^n^ , the red intensity corresponding to the location (m,n) is 



X^^n-^X^ . the ^ 

given by R = 4 

intensitycorrespondingto the location (m,n)is givenby G= 2 
andtheblue intensity corresponding to & e Ration (m,n) is given by , = ^4 

22 . Tneapparatusofcl^^^ 

and n indicates a column and X(m,n) 

isthe intens„^ 
nis ,evenin^ 

x{m _ i^-l^Cm + l^^ > * e red inten8ity 



pattern in a location (m,n) where m indicates a row 



IR = 



_ ^(m^^lilfelll^ the green 
corresponding to the location (m,n) is given by R = 2 

.tensityco^^^ 

Y(m.n-\)+X{m,n + l) 
intensity eorresponding to the location (m,n) is givenby B - 2 

23 The apparatus of data 20, wherein for a pixe! in the predetermined pixe. 
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r mn \ ifm is an even integer 
a- to the nixel in the location (m,n), u m is. * 

andni sa„oddin.e g er,«hein ft a I e d in.« S «yco n espo„d,n g .o 



Jf(ra 



intensity 



co™spo„din g to.heloca t ion(m,n)isgivenbyB= - 2 



,,•■>() wherein for a pixel in the predetermined pixel 
2 , ^apparatasofclarnrZO, where, (mn) 

^nraleeationC^wherenrrn^arowandnnd^ - 



integers 

lbyi? = X(m,«),the green intensity corresi 



given 



G = 



XfjM-MliX^ , the red intensity eorrespond,n g to the .ocation (m,n) . 

ending to the location (m,n) is ^ven by 

X (m -M)±£(^,anddreblne intensity correspond^ to d>e loeation (nr,n) 



_X{m 
is given by B - 



25 An apparatus comprising: 
of pixel data; and 
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a color filter array (CFA) to pass selected wavelengd. ranges to respective pixel 
tocations of fire CMOS sensor according to a predetermined pattern, wherein the 
wave.engdr ranges include a, .east infrared wavelengths for one or more pixe. locations. 

26. The apparatus of claim 25 wherein the predetermined pattern comprises: 
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IR 
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IR 
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1 B 


R 


IR 


G 


IR 


G 



whereRindxcates red intensity information, G indicates green « 

indicates blue intensity information and IR indicates infrared intensity information. 

27. The apparatus of claim 26, wherein for a pixel in the predetermined pixel 

pattern ^V^M^*^*™**^*^*^ 
is the intensity corresponding to thepixelin the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

_ Xijn-U^ t the red intensity corresponding to the location (m,n) is 



IR = 



given by 



= X(m,n-l)+X{m,n + l ) ^ ^ ffKa mtens it y corresponding 



to the location 



(m,n) is given by G = 4 

and the blue intensity corresponding to the location (mm) is given by B = X(m,n). 

28. The apparatus of claim 26, wherein for a pixe. in the predetermined pixel 
pattern in a location (tn,n) where m indicates a row and n indicates a column and X(m,„) 
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the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
integer, the infrared intensity corresponding to the location (m,n) is given by 
X (m -l,n-l) + ^(m + l,n-l) + X(m-l,» + l)+^(m + l,» + l) ^ ^ red intensity 



is 

n is an even 



m = 4 



corresponding to the location (m,n) is given by R = X(m, n) , the green intensity 

, _ X(m-\,n)+ X{m + \,n) . , 
corresponding to the location (m,n) is given by G = » ^ lIlc 

blue intensity corresponding to the location (m,n) is given by 
X(m, » -l)+X(m,» + l) 

29. The apparatus of claim 26, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 

and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 

by IR = (m,n), the red intensity corresponding to the location (m,n) is given by 

X( m-l,n-\) + X(m + l,n-\)+X( m-l,n + \)+X(m + l,n + \) ? ^ ^ inte nsity 
R= ~ 4 

• , ^ • u + and the 

corresponding to the location (m,n) is given by G = 

blue intensity corresponding to the location (m,n) is given by 

X(m -l,n)+X(m + l,n) 
B= - • 

30. The apparatus of claim 26, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
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is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

X(m,n-\)+X{m,n + l) ^ red intensity corresponding to the location (m,n) is 
2 

X(m-\,n) + X{m + \,n) ± intensity corresponding to the location 
given by R = — r > 1 5 

(m,n) is given by G = X(m,n), and the blue intensity corresponding to the location (m,n) 

X{m - l ,n-l) + X(m + l,n-l) + X(m-l,n + \)+X(m + \,n +}) 
is given by B = 4 

31. The apparatus of claim 25 wherein the predetermined pattern comprises: 



IR 


R 


IR 
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G 


IR 


i G 


IR 


IR 


B 


IR 


R 


G 


IR 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



32. The apparatus of claim 31, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m, n) , and the green intensity corresponding to the location (m,n) is given by 

X(m-l,n) + X(m + \,n) ^ where i n if the pixel at location (m,n-l) is red, 
2 

the blue intensity corresponding to the location (m,n) is given by B = X(m, n + 1) and the 
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red intensity corresponding to the iocation (m,n) is given by * - *0* . - •) . - * *• 
pixei a, iocation (m,n-D is b.ue, the red intensity corresponding to the .ocation (t»,n) is 
given by R - X( m ,n+ l)and the bine intensity corresponding .0 the iocation (m,n) is 
given by B = X(m, n - 1) ■ 

33. The apparatns of claim 31. wherein for apixe. in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a coiomn and X(m,n) 

is .he intensity corresponding to the pixel in the location (m,n), if nr is an odd integer and 

„ is an even integer, the infrared intensity copending to the iocation (tn,n> is given by 

X(m-\ »)-*• X(m+tn ) + X{m,n-\)+ X{m,n + \) ^ green intensity 
IR = — — 4 

corresponding to the location (m,n) is given by 

y ( w -Ui-j)+g(m^ and further wherein 

G = ' ' 4 

if the pixel at location (m,n) is red, the blue intensity corresponding to the location (m,n) 

Xim-^Xijr^^ and the red 

is given by B = 4~~ 

intensity corresponding to the iocation (nt,n, is given by R - X(-, .) , and if the pixei a, 
iocation (m,n) is bine, the te* intensity corresponding to the iocation (m,n) is given by 
B - » and the bine intensity corresponding to the location (nt,„) is given by 

yfm - -) ■ "(~^ " U X(m.n-2hX(m,n + 2) 
« = -i 4 



34. The apparatns of claim 31, wherein for apixe! in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a commn and X(nr,n) 
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is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by m = X(m, n-\) + X{m, n + 1) + X(m - 1 , n) + X(m + 1, n) ^ intensity 

corresponding to the location (m,n) is given by G = X{m,n) and further wherein if the 
pixel at location (m-l,n-l) is red, the blue intensity corresponding to the location (m,n) is 
given by B = x ( w " 1 >" + 1 ) + x ( m + l >"- 1 ) an d the red intensity corresponding to the 

, . , K p X(m-\,n-l)+X{m + l,n + \) ^ ifthe pixe i at location 
location (m,n) is given by R = — - » dUU u,c v 

(m-l,n-l) is blue, the red intensity corresponding to the location (m,n) is given by 

R X{m-\,n + l)+{m + l,n-i) ^ ±q bJue intensity corresponding to the location 
2 

, „ X(m-\,n-l)+ X{m + \,n + \) 
(m,n) is given by B = • 

35. The apparatus of claim 3 1 , wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both even 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X{m,n) , and the green intensity corresponding to the location (m,n) is given by 

= X(m,n-l) + X(m,n + \) ^ wherein if th e prxe l at location (m-l,n) is red, 
2 

the blue intensity corresponding to the location (m,n) is given by B = X{m + 1, n) and the 
red intensity corresponding to the location (m,n) is given by R = X(m -l,n), and if the 
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pixel a, location (m-l,» + l) is b.ue, the red intensity corresponding to the .ocation (m,n) is 
given by R = X( m +\,n) and the blue intensity corresponding to the location (m,n) is 
given by B = X{m-\,n). 



36. 



The apparatus of claim 25 wherein the predetermined pattern comprises: 



B 
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i IR 


i G 


IR 
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G 


IR 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 

37. The apparatus of claim 36, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a cohrmn and X(m,n) 
is the intensity corresponding to the pixe. in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

X ( m -l, n -l)r-X(m-l.n-H)+^('"- | -hn-H)+^("' + l."-l) ^ ^ red intensity 
IR = — 4 

X^HzlHlfc^, the green 
corresponding to the location (m,n) is given by R - 2 - ~ 

_X(m-l,n) + X(m + \,n) 
intensity corresponding to the location (m,n) is given by G - 2 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 



38. The apparatus of claim 36, wherein for a pixel in the predetermined pixel 

indicates a row and n indicates a column and X(m,n) 



pattern in a location (m,n) where m 
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is th e density corresponding to the pixel in ft. locaUon (m ,n), if m is an odd integer and 
n is an even ,n.eger, the infrared intensity corresponding to the location (m,n) is given by 

m Xtm-\,n) + X(m + \,«) th£ . red i n , ens ity corresponding to the location (raji) is 
IR- 

givenby R = X M ,±* green intensity corresponding to the location (m,n) is given by 

X( m-l,/i-l)+^ + l,yi-l)+^(«- 1 ."tjl ±£fei±i^ , and the blue 

G = - 1 ' 4 

_X{m,n-\)+X{m,n + \) 
intensity corresponding to the location (m,n) is given by B - — 2 



39. The apparatus of claim 36, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a colunm ^ 
is th e intensity corresponding to the pixel in the location (m,n), if m is an even integer 
andnis an odd integer.the infrared intensity corresponding to the location (m,n) is given 

n X( m,n-l) + X(m,n + l) red intensit corresponding to the location (m,n) is 
by IR = ~^ ' 

X (m - 1 w -lU^m + l,n-l)+^(« + ^"j^ j^fe±l^ , the green 
given by R = 4 

intensity corresponding to the location (m,n) is given by G = Xim. »>• *• btoe 

_X(m-l,n)+^( m+1 >") 
intensity corresponding to the location (m,n) is given by B - 2 



40. The apparatus of claim 36, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where « indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding ,0 d. pixel in the location <tn,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
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IR = X(m, n) , the red intensity corresponding to the location (m,n) is given by 

= X(m-\,n) + X{m + \,n) ^ ^ gfeen intensity corresponding to the location (m,n) is 



given by G 



X{m,n + \) + X(m,n-l) ^ ^ blue intens i ty corresponding to the 
2 



location (m,n) is given by 



B = 



Y(rr,-\.n-l) + X(m + l,n + \) + X{m-\,n + \)+X{m + l,n-\) 



41. The apparatus of claim 25 wherein the predetermined pattern comprises: 



B 


G 


B 


B 


IR 


R 


IR 


I R 


B 


G 


B 


G 


IR 


R 


IR 


R 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



42. The apparatus of claim 41, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

X(m-\,n) + X(m + l,n) ±q red intensity corresponding to the location (m,n) is 
2 

X(m-l,»-l)+^-l^ + l)+^( ffl + 1 ^ + 1 ) +; ^±l^ , the green 



IR 



given by R = 
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_X(m,n-l) + X(m,n + V) 
intensity corresponding to the location (m,n) is given by G - J~ 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 

43. The apparatus of claim 41, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to thepixel in the location (m,n), if mis an odd integer and 

n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

X( m - 1 n - 1) + Xim + !,«-!) + X{m-\,n + l)+ Jf(m + l,« + l) ^ ±q rQ& intensity 
IR = — ' 4 

x . . K , Xim -l,n)+ X{m + \,n) ^ 
corresponding to the location (m,n) is given by R- 2 

intensity corresponding to the location (m,n) is given by G = X(m, n) , and the blue 

_ X{m,n-\)+X{m,n + \) 
intensity corresponding to the location (m,n) is given by B - — 



44. The apparatus of claim 41, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a colurn^ 
is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = X(m,n), the red intensity corresponding to the location (m,n) is given by 
r = X(m-U) , the green intensity corresponding to the location (m,n) is given by 
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4 I 



G = 



y^^-^ , and the blue 



_X{m-l,n)+X{m + l,n) 
intensity corresponding to the location (m,n) is given by B - 2 



45. The apparatus of claim 41 , wherein for a pixel in the predetermined pixel 
p atteml nalocation(m,n)wheremindicatesarowandnindic^ 
is the intensity corresponding to thepixelin the location (m,n), ifm and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
tb x Un-\)+X{m,n + \) the red inten sity corresponding to the location (m,n) is 

given by R = X(m, n) , the green intensity corresponding to the location (m,n) is given by 

X(m - 1, n) + X(m + 1, n) ^ fee blue intensity corresponding to the location (m,n) 
G= 2 ' 

is given by B = 4 

46. A method comprising: 

receiving pixel data representing eolor intensity values for a plurality of pixel 
.oeations according to a predetermined partem, wherein one or more of the color intensity 
values corresponds to intensity of light having infrared wavelengths; 

generating intensity values for multiple color intensities corresponding to a single 
pixel location hy hrterpolating intensity values corresponding to neighboring pixel 
locations; 

promoting one or more of the generated intensity values to a user-accessible state. 
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47. The method of claim 46 wherein promoting the one or more of the 

-accessible state comprises storing the received 



generated intensity values to a user- 



values on a computer-readable storage device. 



intensity values and the generated intensity < 

48. Themethodofclaim46whereinpromotingtheoneormoreofthe 

generated intensity values to a user-accessible state comprises: 

generatinganoutput image with the received intensity values and the generated 

intensity values; and 

displaying the output image on a display device. 

49. The method of claim 46 wherein promoting the one or more of the 
generated intensity values to a user-accessible state comprises: 

intensity values; and 

printing the output image. 



50. The 



me «hod of claim 46 wherein the predetermined pattern comprises: 



B 
IR 


R 

G 


B 

1 IR 


R 

1 G 


B 


R 


B 


R 


IR 


G 


IR 


G 











where R indicates red intensity —on, G indicates green intensity information, B 
indicates bine intensity information and IR mdiea.es infrared intensity —on. 
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51 . The method of claim 50, wherein for a pixel to the predetermined pixel 
pattern to a location (m,n) where m indicates a mw and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel to the location (mm), if m and n are horn odd 
tategers, the infrared intensity corresponding to tire location (m,n) is given by 

_ X(m-l,n) + X(m + l,n) _ the red intensity corresponding to the location (m,n) is 
IR — — 



2 

X 

given by 



_ xUn-\)+X{m,n + l) ^ ^ ^ intensity corresponding to the location 

R - y~ 

(m,n) is given by G = 4 

m d the blue intensity corresponding to the location (m,n) is given by B=X{m,n). 



52 . The method of claim 50, whereto for a pixel in the predetermined pixel 

pattern in a location (m,„) where m indicates a row and n indicates a column and X(m,„) 

„ the tolensity corresponding «o the pixel to the location (m,n), if m is an odd integer and 

. is an even integer, toe infrared intensity corresponding .0 the location (m,n) is given by 

X(m - 1 » - 1) + Xlm*\.n-l) + X( n.-\.n+i)*Mm + i,"^) ( ^ red intensity 
/J! = — 1 ~\~ 

corresponding to tbe location (m,n) is given by R = X M , the green intensity 

x(m-\,n)+X{m + l,n) onAthp 
corresponding to the location (m,n) is given by U - 2 

blue intensity corresponding to the location (m,n) is given by 

X{m,n-\)+X{m,n + \) 
B = — ■ Z 
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53. The method of claim 50, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = (m,n), the red intensity corresponding to the location (m,n) is given by 

X(m-l,n-l)+X{m + l,n-l) + X{m-l,n + l)+X{m + \,n + \) ^ ^ ^ intensity 



R = 



corres 



_ X( m,n-\)+X{m,n + \) dthe 
;ponding to the location (m,n) is given by O = ■ ^ 



blue intensity corresponding to the location (m,n) is given by 
X(m-\,n)+X{m + \,n) 



B = 



54. The method of claim 50, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

= X(m,n-l)+X{m,n + l) ^ ±q red intensity corresponding to the location (m,n) is 
2 

iven by R = X(?w ~ 1 '^ + X(m + 1, " ) , the green intensity corresponding to the location 

2 

(m,n) is given by G = X(m, n) , and the blue intensity corresponding to the location (m,n) 

X(m-\. n-l) + X(m + \,n-l) + X (m-ln + i)+X{m + \,n + l) 
is given by B = — 4 



55. 
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The method of claim 46 wherein the predetermined pattern comprises: 
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IR 


R 


IR 


B 


G 


i IR 


G 


1 IR 


IR 


B 


IR 


R 


G 


IR 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 

56. The method of claim 55, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR 



= X(m,n) , and the green intensity corresponding to the location (m,n) is given by 



X(m-\,n) + X{m + \,n) ^ forther wherein if the pixel at location (m,n-l) is red, 
2 

the blue intensity corresponding to the location (m,n) is given by B = X(m, n + 1) and the 
red intensity corresponding to the location (m,n) is given by R = X(m, n - 1) , and if the 
pixel at location (m,n-l) is blue, the red intensity corresponding to the location (m,n) is 
given by R = X(m, n + 1) and the blue intensity corresponding to the location (m,n) is 
given by B = X(m,n-\). 



57. The method of claim 55, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 
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X(m-l,n) + X(m + l,n) + X{m,n-\)+ X(m,n + l) ^ ^ intensity 

corresponding to the location (m,n) is given by 

X{m-\,n-\)+X{m + \,n-\)+X{m-\,n + \)+X{m + \,n + \) ^ where i n 



G = 



4 



if the pixel at location (m,n) is red, the blue intensity corresponding to the location (m,n) 

X(m - 2,n)+X(m + 2,n)+X{m,n-2) +X{m,n + 2) ^ ±Q red 
is given by B = 

intensity corresponding to the location (m,n) is given by R = X(m,n), and if the pixel at 
location (m,n) is blue, the red intensity corresponding to the location (m,n) is given by 
B = X(m, n) and the blue intensity corresponding to the location (m,n) is given by 
X(m-2.n)+X(m + 2,n)+X{m,r 1 -2)+X{m,n + 2) 



R = 



58. The method of claim 55, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 

and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 

X{m, n - 1) + X(m, n + 1) + X (m - 1, n) + X{m + 1, n) ^ mtensi ty 
by IR = ' 1 

corresponding to the location (m,n) is givenby G = X(m,n) and further wherein if the 

pixel at location (m-l,n-l) is red, the blue intensity corresponding to the location (m,n) is 

, „ x(m- hn + \)+X{m + \,n-\) ^ ^ rpA i ntensit v corresponding to the 
given by a = ~ 

. . n X( m-\,n-\) + X{m + \,n + \) andifthep i xe l at location 
location (m,n) is given by R = — 

A o Express Mail No. EV 325528247 US 

42P17531X 



(m-l,n-l) is blue, the red intensity corresponding to the location (m,n) is given by 

X(m-l,n+l)+(m + l,n-\) ^ ±e Wue intensity corresponding to the location 
*- 2 

X(m - 1, n -\)+X{m + l,w + l) 
(m,n) is given by B = - 

59. The method of claim 55, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both even 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m, n) , and the green intensity corresponding to the location (m,n) is given by 



G = 



= X(m,n-\) + X(m,n + \) ^ mhQT wherein if the pixel at location (m-l,n) is red, 
2 



the blue intensity corresponding to the location (m,n) is given by B = X(m + 1, n) and the 
red intensity corresponding to the location (m,n) is given by R = X(m - In), and if the 
pixel at location (m-l,n+l) is blue, the red intensity corresponding to the location (m,n) is 
given by R = X(m + \,n) and the blue intensity corresponding to the location (m,n) is 
given by B = X(m-l,n). 



60. The method of claim 46 wherein the predetermined pattern comprises: 



B 


R 


B 


R 


G 


IR 


G 


IR 


B 


R 


B 


R 


G 


IR 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 
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61. The method of claim 60, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intens-ity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

_ x {m-l,n-\)+X(m-\,n + l)+X(m + ln + \)+X {m + \,n-\) ^ ±e red intensity 
IR - — 4 

. „ X(m,n -\)+X{m,n + \) . 
corresponding to the location (m,n) is given by R = > U1C s 

X(m-\,n) + X(m + \,n) 
intensity corresponding to the location (m,n) is given by G - - 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 

62. The method of claim 60, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 



IS 



the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
integer, the infrared intensity corresponding to the location (m,n) is given by 



n is an even : 



X(m-\,n) + X(m + l,n) &e fed intensity corresponding to the location (m,n) is 
2 

given by R = X(m, n) , the green intensity corresponding to the location (m,n) is given by 

X(m -\,n -l)+X(m + l,»-l)+X(m-l,n + l) + X(m + l,» + l) ^ ^ ^ blue 
G = — 1~ 

_ X{m,n-\)+ X{m,n + \) 
intensity corresponding to the location (m,n) is given by B - - 
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63 . The method of claim 60, wherein for a pixel in the predetermined pixel 

is the intensity corresponding to the pixel in the location (m,n), if m is an even .nteger 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 

X(m.n -\) + X(m,n + l) red intensity corre sponding to the location (m,n) is 
by IR = 2 ' 

X (m -\^)+Xi^ , the green 

given by R = — 4 

intensity corresponding to the location (m,n) is given by G^(.,n), and the blue 

_X{m-l,n)+X{m + l,n) 
intensity corresponding to the location (m,n) is given by B - - 2 



64 . The method of claim 60, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR - X(m, n) , the red intensity corresponding to the location (m,n) is given by 

^^>±^^ the green intensity corresponding to the location (m,n) is 
R ~ 2 

X(m^i + l)+^(^zll and the blue intensity corresponding to the 
given by G = — ^ 

location (m,n) is given by 

B = -± T 

65. The method of claim 46 wherein the predetermined pattern comprises: 
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IR 
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IR 


L R 
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B 


G 


IR 


R 


IR 


R 



where R indiea.es red intensity information, G indieates green intensity information, B 
indicates blue intensity information and IR indieates infrared intensity infotmation. 



66. The 



method of claim 65, wherein for a pixel in the predetermined pixel 



pattern in a location (m,n) where m 



indicates a row and n indicates a column and X(m,n) 



is me intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

_ X(m - 1, n) + X(m + 1, n) ^ red intensi ty corresponding to the location (m,n) is 
IR- - 

X (m -l. W -l)+X(m-l,n + l)+^ + l>" + 1 l± lfei±l^ , the green 
given by R = - 4 

_ X(m,n-\) + X(m,n + l) 
intensity corresponding to the location (m,n) is given by G - 2 



and the blue intensity 



ity corresponding to the location (m,n) is given by B - X{m,n). 



67. The method of claim 65, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 
,_!,„_!) + X(m + \,n-l) + X(m-l,n + \)+X{m + l,ri^}) ^ me fed inten sity 



IR = 



X(m 



s . . . , X(m-Un)+X(m + l,n) ^ 
corresponding to the location (m,n) is given by R- 2 
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tensity corresponding .o the .oeation (m,n) is given by 0 - *(-,-) . - *■ <*» 
intensity eorresponding to the location (m,n) is given by B = % 

68 The method of claim 65, wherein for a pixe! in .he predetermined pixe. 
pattern in a locatron <m,n) where nt indicates a row and n indtcates a co.omn and X(m,n) 
is the intensity corresponding to the pixe! in the .ocation (m,n), if nr is an even integer 
ma n is an odd integer, the infrared intensity corresponding «o the location (■»,„) is gtven 
by IR = X(m, «), the red intensity eorresponding .o the location (m,n) is given by 
R . X(m - 1, .) , «he green intensity corresponding .o the location (m,n) is given by 

W„ -1 „ - ^x(m + l.n-\)+X (n,-V.n + i) + X(m + l,n*\) _ md , he Wue 
C = — 1 V 

x(m r U)+X(m + l,n) 
intensity corresponding to the location (m,n) is given by B = 2 



69 The method of claim 65, wherein for a pixe. in the predefined pixel 
panem in a location (tn,n) where m indicates a row and n indicates a cohtmn and X(m,n) 
U the intensity corresponding to the pixe, in the location (m,n), if m and n are both odd 
integers, the inifared intensr.y corresponding to Are .ocation (m,n) is given by 



_ x(m.n-\)+Xfan+i) ^ raJ intensity COII espondhig to the location (dmO is 
IR- J~ 

given by R - X(n,,n), the green intensity corresponding to me location (m,n) is given by 
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_ x^^ny^ f md the blue intensity corresponding to the location (m,n) 



G = 



is given by B = 



1 tt-I)^ Y^^.n + l^Xim+ln-lhX^A^ 



70. A sensor that receives 
plurality of pixel locations of a scene 



pixel data representing color intensity values for a 
to be captured according to a predetermined pattern, 



wherein one or more of the 
infrared wavelengths. 



color intensity values corresponds to intensity of light having 



71. The sensor of claim 70 wherein red intensity values, green intensity 
values, blue intensity values and infrared intensity values are capture substantially 
contemporaneously. 



72 



The apparatus of claim 70 wherein the predetermined pattern comprises: 
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IR 


__G 



where R indicates red in.ensiry information, G indicates green intensity information, B 
Miea.es bine intensity information and IR indicates infrared in.ensity information. 
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The apparatus of claim 70 wherein me predetermined pattern comprises: 
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where R indicates red intensity information, G tndicates gmen intensity information, B 
indicates bine intensity information and R indicates infrared intensity information. 

74. The apparatus of claim 70 wherein the predetermined patten, comprises: 



B 


R 


B 


R 


G 


, IR 


G 


IR 


" B 


R 


B 


R 


G 


m 


G 


IR 



where R indicates red intensity information, G indicates green intensity information, B 
indicates bine intensity information and IR indicates infrared intensity information. 



75. 



The apparatus of claim 70 wherein the predetermined pattern comprises: 
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IR 


R 1 


IR 
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B 
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B 


G 


IR 


R 


IR 


R 



where R indicate, red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



76. An apparatus comprising: 
lens system to focus a scene to be captured; and 



a 

a sensor to capture color data representing the scene passed by the lens system, 
the sensor to capture color intensity information according to a predetermined pixel 
pattern, wherein the color intensity information comprises a. least infrared intensity 
information. 
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77. The apparatus of claim 76 wherein the predetermined pattern comprises: 



B 


, R 
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G 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



78. The apparatus of claim 76 wherein the predetermined pattern comprises: 
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where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



79. The apparatus of claim 76 wherein the predetermined pattern comprises: 
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where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 
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The apparatus of claim 76 wherein the predetermined pattern comprises: 
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IR 
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G 1 


B 
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IR 


R 


IR 


R 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



81. An article of manufacture comprising an electronically accessible medium 
having stored thereon instructions that, when executed, cause one or more processors to: 

receive pixel data representing color intensity values for a plurality of pixel 
locations according to a predetermined pattern, wherein one or more of the color intensity 
values corresponds to intensity of light having infrared wavelengths; 

generate intensity values for multiple color intensities corresponding to a single 
pixel location by interpolating intensity values corresponding to neighboring pixel 
locations; 

promote one or more of the generated intensity values to a user-accessible state. 

82. The article of claim 81 wherein the instructions that cause the one or more 
processors to promote the color intensity values to a user-accessible state comprise 
instructions that, when executed, cause the one or more processors to store the captured 
intensity values and the interpolated intensity values on a computer-readable storage 
device. 
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83. The article of claim 81 wherein the instructions that cause the one or 
processors to promote the color intensity values to a user-accessible state comprise 
instructions that, when executed, cause the one or more processors to: 

generate an output image with the received intensity values and the generated 

intensity values; and 

display the output image on a display device. 



more 



84. The article of claim 81 wherein the instructions that cause the one or 
processors to promote the color intensity values to a user- accessible state comprise 
instructions that, when executed, cause the one or more processors to: 

generate an output image with the received intensity values and the generated 

intensity values; and 

print the output image. 



more 



85. The article of claim 81 wherein the predetermined pattern comprises: 
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where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



86. The article of claim 85, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
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integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m-\,n) + X(m + l,n) ^ ±q red intensity corre sponding to the location (m,n) is 



given by 



2 

R = X(m,n-\)+X(m,n + l) ^ ^ intensity corresponding to the location 



X(m - 1, n - 1) + X( m-l,n + \) + X(m + l,n-\) + X(m + \,n + l) 
(m,n) is given by G = ■ ■ ^ 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 



87. The article of claim 85 , wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 

n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

TD _ X( m-U-l) + X(m + hn-\) + X (m-l,n + \)+X(m + \,n + \) ^ rgd intensity 
IR- 

corresponding to the location (m,n) is given by R = X(m, n) , the green intensity 

. . t _ X(m-\, n)+X(m + l,n) 
corresponding to the location (m,n) is given by G = . ano me 

blue intensity corresponding to the location (m,n) is given by 

X(m, n-\)+X{m,n + \) 
B= " • 

88. The article of claim 85, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
42P17531X -59" Express Mail No. m25528247US 



by IR = (m,n), the red intensity corresponding to the location (m,n) is given by 

X( m -l,n-\) + X(m + \,n-l)+X(m-l,n + \)+X(m+\,n + \) ^ ±q intensit y 
R= ■ " 4 

. _ X{m,n-\) + X(m,n + \) 

corresponding to the location (m,n) is given by G = - 

blue intensity corresponding to the location (m,n) is given by 
X(m-\,n)+X(m + l,n) 

89. The article of claim 85, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

= X(m,n-\)+X(m,n + \) ^ ^ red isaeD ^ ty corresponding to the location (m,n) is 



given by 



= X(m-l,n) + X(m + \,n) ^ ^ ^ intensity corresponding to the location 



(m,n) is given by G = X(m,n), and the blue intensity corresponding to the location (m,n) 

Y(m-Ln -V) + X(m + \,n-\) + X( m-ln + i) + X(m + l,n + i) 
is given by B = ~ 4 ~ — 



90. The article of claim 81 wherein the predetermined pattern comprises: 
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where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 

91. The article of claim 90, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m,n) , and the green intensity corresponding to the location (m,n) is given by 

= X(m-l,n) + X(m + l,n) ^ ^ wherein if the pixel at location (m,n-l) is red, 

2 

the blue intensity corresponding to the location (m,n) is given by B = X{m,n + 1) and the 
red intensity corresponding to the location (m,n) is given by R = X(m,n- 1) , and if the 
pixel at location (m,n-l) is blue, the red intensity corresponding to the location (m,n) is 
given by R = X(m, n + 1) and the blue intensity corresponding to the location (m,n) is 
given by B = X(m, n-l). 

92. The article of claim 90, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 

n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

TR _ X(m-l,n) + X(m + \,n) + X{m,n-i )+X(m,n + \) ^ ^ intengity 

4 

corresponding to the location (m,n) is given by 
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G = 
if the 



X(m-l,n-\)+X(m + l,n-i)+X(m-\,n + \)+X{m + \,n + \) ^ mher wherein 



pixel at location (m,n) is red, the blue intensity corresponding to the location (m,n) 

yU- 7 n ) + X(m + 2,n)+X(m,n-2) +X(m,n + 2) 
is given by B = — ^~ 

intensity corresponding to the location (m,n) is given by R = X{m,n) , and if the pixel at 
location (m,n) is blue, the red intensity corresponding to the location (m,n) is given by 
B = X(m, n) and the blue intensity corresponding to the location (m,n) is given by 

X(m - Zn) + X(m + 2,n)+ X(m,n- 2)+ X{m,n + 2) 
R- 4~ 

93. The article of claim 90, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 

and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 

X(m, n - 1) + X(m, n + l) + X (m-\,n)+ X{m+\,n) ^ intensity 
by IR = ^ 

corresponding to the location (m,n) is givenby G = X(m,n) and further wherein if the 

pixel at location (m-l,n-l) is red, the blue intensity corresponding to the location (m,n) is 

, B X{m - ln + \)+X{m + l,n-\) d ^ red intens i ty corresponding to the 
given by B = ^ 

. , n Xlm -ln-i)+X{m + \,n + \) and ifthe pixel at location 
location (m,n) is given by K = ^ 

(m-l,n-l) is blue, the red intensity corresponding to the location (m,n) is given by 



42P17531X 



-62- 



Express Mail No. EV 125528247 US 



X(m-l,n + \)+(m + l,n-\) ^ ^ Wue intensity corresponding to the location 



X(m-l n-l)+X{m + \,n + \) 
(m,n) is given by B = 



94. The article of claim 90, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 



IS 



the intensity corresponding to the pixel in the location (m,n), if m and n are both even 
integers, the infrared intensity corresponding to the location (m,n) is given by 



IR 



= X(m,n) , and the green intensity corresponding to the location (m,n) is given by 



G = 



= X(m,n-\) + X(m,n + l) ^ ffa&ja wherein if the pixel at location (m-l,n) is red, 
2 



the blue intensity corresponding to the location (m,n) is given by B = X(m + \,n) and the 
red intensity corresponding to the location (m,n) is given by R = X(m-l,n), and if the 
pixel at location (m-l,n+l) is blue, the red intensity corresponding to the location (m,n) is 
givenby R = X(m + l,n) and the blue intensity corresponding to the location (m,n) is 
given by B = X(m-\,n). 



95. The article of claim 81 wherein the predetermined pattern comprises: 
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where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 
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96. The article of claim 95, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
_ X(m-l,n-i)+X(m-l,n + \)+X{m + \,n + \)+X{m + \,n-l) ^ ^ ^ 



IR = 



X(m,n-l)+X(m,n + \) , 
corresponding to the location (m,n) is given by R = » me & QQn 

. „ X(m-l ,n) + X(m + l,n) 
intensity corresponding to the location (m,n) is given by G = » 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 



97. The article of claim 95, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 
n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

IR _ X(m-\,n) + X{m + \,n) ^ ^ ^ i ntens i ty corresponding to the location (m,n) is 
2 

given by R = X(m, n) , the green intensity corresponding to the location (m,n) is given by 



X{m-\n-\)+X(m + \,n-\)+X(m-\,n + \)+X(m + U + \) ^theblue 
G = 

x • • u d X(m,n -i)+X{m,n + l) 
intensity corresponding to the location (m,n) is given by B = 



98. The article of claim 95, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
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is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = X(m,n-l) + X(m,n + \) ^ ^ red intensity corresponding to the location (m,n) is 

X(m -\,n- \) +X(m + l,n-\)+X(m + \,n + i)+ X(m+U-\) ±& 
given by R = 4 

intensity corresponding to the location (m,n) is given by G = X(m, n) , and the blue 

X(m -l,n)+X(m + l,n) 

intensity corresponding to the location (m,n) is given by B = - - • 



99. The article of claim 95, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m, n) , the red intensity corresponding to the location (m,n) is given by 
R = X(m-\,n) + X(m + \,n) ^ ±q ^ QQn intensity corresponding to the location (m,n) is 



given 



by G _ X(m,n + l) + X(m,n 1) ^ ^ ^ blue intensity corresponding to the 



location (m,n) is given by 

X(m-l,n-l) + X(m + l,n + \) + X(m-l,n + i)+X(m + l,n-l) 



B = 



1 00. The article of claim 8 1 wherein the predetermined pattern comprises: 
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* I 



IR 


R 


IR 


R 



where R indicates red intensity information, G indicates green intensity information, B 
indicates blue intensity information and IR indicates infrared intensity information. 



101. The article of claim 1 00, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 
IR = X(m-\,n) + X{m + \,n) ^ ^ red intensity corresponding to the location (m,n) is 



given by 



R = X(m-U-l)+X(m-ln + l)+X(m + l,n + \)+X{m + \,n-\) ^ ±& ^ 



• , ■ u ^ X(m,n -\) + X(m,n + l) 
intensity corresponding to the location (m,n) is given by G = 

and the blue intensity corresponding to the location (m,n) is given by B = X(m,n). 



102. The article of claim 100, wherein for a pixel in the predetermined pixel 

pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 

is the intensity corresponding to the pixel in the location (m,n), if m is an odd integer and 

n is an even integer, the infrared intensity corresponding to the location (m,n) is given by 

= X(m-l,n-l) + X(m + \,n-l) + X(m-\,n + \)+X(m + l,n + l) ^ ^ ^ 

4 

. . , „ X(m-l,n)+X{m + l,n) 
corresponding to the location (m,n) is given by R = — , tne green 
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intensity corresponding to the location (m,n) is given by G = X{m, n) , and the blue 

X (m,n-l)+X(m,n + \) 
intensity corresponding to the location (m,n) is given by B - - 



103. The article of claim 100, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m is an even integer 
and n is an odd integer, the infrared intensity corresponding to the location (m,n) is given 
by IR = X(m, n), the red intensity corresponding to the location (m,n) is given by 
R = X (m- 1, n) , the green intensity corresponding to the location (m,n) is given by 

X(m - ln-l)+X{m + U-l)+X{m-ln + l)+X{m + l,n + l) > ^ &e blue 
G= - 4— 

X{m-l,n)+X(m + l,n) 

intensity corresponding to the location (m,n) is given by B - - • 



104. The article of claim 100, wherein for a pixel in the predetermined pixel 
pattern in a location (m,n) where m indicates a row and n indicates a column and X(m,n) 
is the intensity corresponding to the pixel in the location (m,n), if m and n are both odd 
integers, the infrared intensity corresponding to the location (m,n) is given by 

TR X(m,n-\)+X(m,n + \) ±e red intensity corresponding to the location (m,n) is 
2 

given by R = X(m,n), the green intensity corresponding to the location (m,n) is given by 
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G = X ^ m 1 ^) + x ( w + 1 '") ^ the blue intensity corresponding to the location (m,n) 
2 

. . L „ AT(ifi -l,it -1) + + 1, w + 1) + A'Ciw + 1,» - 1)+ ^( m - 1,« + 1) 
is given by B = ^— • 
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